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Abstract. This paper provides a geometrical derivation of the Hybrid Minimum Principle 
(HMP) for autonomous impulsive hybrid systems on Riemannian manifolds, i.e. systems where the 
manifold valued component of the hybrid state trajectory may have a jump discontinuity when the 
discrete component changes value. The analysis is expressed in terms of extremal trajectories on the 
cotangent bundle of the manifold state space. In the case of autonomous hybrid systems, switching 
manifolds are defined as smooth embedded submanifolds of the state manifold and the jump function 
is defined as a smooth map on the switching manifold. The HMP results are obtained in the case of 
time invariant switching manifolds and state jumps on Riemannian manifolds. 
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1. Introduction. The problem of hybrid systems optimal control (HSOC) in 
Euclidean spaces has been studied in many papers, see e.g. [SJ HI [TTl [T^ [TH [T3 
[lailllEllEailQllSaiMlllI]- in particular, [H [HI |30l [32] present an extension of 
the Minimum Principle to hybrid systems and [30] gives an iterative algorithm which 
is based upon the Hybrid Minimum Principle (HMP) necessary conditions for both 
autonomous and controlled switching systems. In general the previously cited papers 
consider HSOC problems with a priori given sequences of discrete transitions. In 
addition, [T7] includes the case of switching costs. 

We note that historically optimal control theory has mainly used the term Maxi- 
mum Principle since optimal controls were derived via the maximization of a Hamilto- 
nian function, see e.g. |25| . However, since we work with problems in the Bolza form 
we formulate the theory in terms of the minimization of a suitably defined Hamiltonian 
function and consequently shall consistently use the term Minimum Principle. 

A geometric version of Pontryagin's Minimum Principle for a general class of state 
manifolds is given in [TJ[S1|32]. In this paper, we employ the control needle variation 
method of [S], [O] and [37] to analyze state variation propagation through switching 
manifolds and hence we obtain a Hybrid Minimum Principle for autonomous hybrid 
systems (i.e. systems without controlled distinct state switchings) on Riemannian 
manifolds. It is shown that under appropriate hypotheses on the differentiability of 
the hybrid value function, the discontinuity of the adjoint variable at the optimal 
switching state and switching time is proportional to a differential form of the hybrid 
value function defined on the cotangent bundle of the state manifold. In the case of 
open control sets and Euclidean state spaces this result for impulsive hybrid systems 
appeared in [26^ without using the language of differential geometry. We note that the 
analysis in this paper extends to the case of multiple autonomous switchings which 
has been treated in [30] for hybrid systems defined on Euclidean spaces. 

The continuity of the Hamiltonian function in the case of time invariant switching 
manifolds is derived in [3D| for open control value sets by employing the methods of 
the calculus of variations. In this paper, for compact control value sets, we obtain the 
continuity result for the Hamiltonian function at the optimal switching time by use 
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of the needle variation method. In particular we note that here the needle variation 
method is generalized to a class of autonomous hybrid systems associated with time 
varying embedded switching manifolds when the Hamiltonian function is discontin- 
uous at optimal switching times. It is shown that the discontinuity is related to a 
differential form of an augmented hybrid value function. 

In this paper, in Section [2] we give a general definition of hybrid systems on 
differentiable manifolds and then in Section [3] present a geometric version of the 
Pontryagin Minimum Principle for optimal control systems. In Section[4]we obtain the 
Hybrid Minimum Principle for impulsive hybrid systems using the method of needle 
variations. Complete proofs of the results of Section |3] are given in the Appendices 
[A]|C| Furthermore the analysis of those cases where the hybrid value functions are 
differentiable, and the switching manifolds and impulsive jumps are time varying, are 
given in the referenced link [35 . 

2. Hybrid Systems. In the following definition the standard hybrid systems 
framework (see e.g. [SI 130]) is generalized to the case where the continuous state 
space is a smooth manifold, where henceforth in this paper smooth means C°° . 

Definition 2.1. A hybrid system with autonomous discrete transitions is a five- 
tuple 

(2.1) n:={H=QxM,U,F,S,J} 
where: 

Q = {1, 2, 3, IQI} is a finite set of discrete (valued) states (components) and Ai is 
a smooth n dimensional Riemannian continuous (valued) state (component) manifold 
with associated metric ■ 
H is called the hybrid state space o/H. 

U C K," is a set of admissible input control values, where U is a compact set in R". 
The set of admissible input control functions is X (Loo[ioj i/)? C^); set of all 
bounded measurable functions on some interval [tQ,tf),tf < oo, taking values in U. 
F is an indexed collection of smooth, i.e. C°° , vector fields {fqi}qi£Q, where fq. : 
M X U ^ TM is a controlled vector field assigned to each discrete state; hence each 
fq^ is continuous on Ai x U and continuously differentiable on M for all u d U . 

is a collection of embedded time 
independent pairwise disjoint switching manifolds ( except in the case where 7 = (p, q) 
is identified with 7 = {q,p)) such that for any ordered pair 7 = {p, q), is an open 
smooth, oriented codimension 1 submanifold of A4, possibly with boundary dn^. By 
abuse of notation, we describe the manifolds locally by = {x : n^{x) = 0,a: G R"}. 

shall denote the family of the state jump functions on the manifold Ai. For an 
autonomous switching event from p d Q to q € Q, the corresponding jump function 
is given by a smooth map C,p^q : Ai ^ A4: if x(t^) G S the state trajectory jumps to 
x{t) = Cp,q{x{t~)) G Ai, Cp,q € >7 ■ The non-jump special case is given by x(t) = x(t~). 
We use the term impulsive hybrid systems for those hybrid systems where the contin- 
uous part of the state trajectory may have discontinuous transitions (i.e. jump) at 
controlled or autonomous discrete state switching times. 
We assume: 

Al: The initial state ho :— (a;(to),9o) G is such that xq — a; (to) ^ S for all 
qi € Q. A (hybrid) input function u is defined on a half open interval [t^, tf), tf < 00, 
where further u G X. A (hybrid) state trajectory with initial state hg and (hybrid) 
input function m is a triple (r, q, x) consisting of a finite strictly increasing sequence 
of times (boundary and switching times) r ~ {tQ,ti,t2, . ■ ■), an associated sequence 
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of discrete states q = {qo,qi,q2, . . .), and a sequence a:(-) — {xqg{-),Xq^{-),Xq2{-), ■ ■ ■) 
of absolutely continuous functions Xq^ : M. satisfying the continuous and 

discrete dynamics given by the following definition. 

Definition 2.2. The continuous dynamics of a hybrid system H with initial 
condition Hq = {xo,qo), input control function u <E I and hybrid state trajectory 
(t, g, x) are specified piecewise in time via the mappings 

(2.2) {Xq.,u) : [ti,ti+i) ^ M xU, i = 0,...,L, < L < oo, 
where Xq^{.) is an integral curve of fq^{.,u{.)) : A4 x [ti,ti+i) TA4 satisfying 

= fqi{Xqi{t),u{t)), a.e.te [ti,ti+x), 

where a;g.^j(ii+i) is given recursively by 

(2.3) Xq {ti+i) = lim^^^- Qqi^q^+A^qM)^ ho = {qo,xo),t <tf. 

The discrete autonomous switching dynamics are defined as follows: 
For all p, q, whenever an admissible hybrid system trajectory governed by the con- 
trolled vector field fp meets any given switching manifold Up^q transversally, i.e. 
fp{x{tj),t^) ^ T,^,^i.--^S, there is an autonomous switching to the controlled vector 
field fq, equivalently, discrete state transition p —>■(/, P,q €z Q. Conversely, any 
autonomous discrete state transition corresponds to a transversal intersection. 

A system, trajectory is not continued after a non-transversal intersection with a 
switching m,a,nifold. Given the definitions and assumptions above, standard arguments 
give the existence and uniqueness of a hybrid state trajectory (r, q, x), with initial state 
ho € H and input function u T, up to T, defined to be the least of an explosion time 
or an instant of non-transversal intersection with a switching manifold. 

We adopt: 

A2: (Controllability) For any q ^ Q, all pairs of states {xi,X2) are mutually 
accessible in any given time period [to,t],io < t < tf, via the controlled vector field 
iqi*) = fq{xq{t),u{t)), for somc u G Z = {Loo[to,tf),U). 

A3: {lq.}q.^Q, in a famiiy oi loss functions such that Iq. E C'^(A^ x t/; R"*"), fc > 1, 
and ft- is a terminal cost function such that h E C'^{Ai;R'^), k > 1. 

Henceforth, Hypotheses A1-A3 will be in force unless otherwise stated. Let L 
be the number of switchings and w € I then we define the hybrid cost function as 

J{to,tf,ho;L,u) :=22 / lqiixqiis)^'^is))ds + h{xq^{tf)), 

1=0 

(2.4) tL+i=tf <T,ueI, 

where we observe the conditions above yield J{to,tf,ho;L,u) < oo. 

Definition 2.3. For a hybrid system H, given the data {to,tf,hQ;L), the Bolza 
Hybrid Optimal Control Problem (BHOCP) is defined as the infimization of the hybrid 
cost function J (to, tf,ho',L,u) over the hybrid input functions u G I, i.e. 

J"{to,tf,ho;L) = in fuel J {to,tf,ho;L,u). 
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Definition 2.4. A Mayer Hybrid Optimal Control Problem (MHOCP) is defined 
as the special case of the BHOCP where the cost function given in l2.4\ l is evaluated 
only on the terminal state of the system, i.e. Iq- = 0, i = 1, L. 

In general, different control inputs result in different sequences of discrete states 
of different cardinality. However, in this paper, we shall restrict the infimization to 
be over the class of control functions, generically denoted U C I, which generates an 
a priori given sequence of discrete transition events. 

We adopt the following standard notation and terminology, see [9]. The time de- 
pendent flow associated to a differentiable time independent vector field fq. is a map 
satisfying (where for economy of notation (.) := fq-{.,u{t))): 

: [ti,t^+i) X [t^,t,+l) X M, {t,s,x) $/*u'^(a;) := ^f^i{t,s),x) e M, 

where 

(2.5) -.M^M, <i>^fy\x) = X, 

(2.6) = t:^^ 

We associate T^'^•ff\.) to ^^h^^ : M ^ M via the push-forward of ^f*;*-*. 

(2.7) T$(?' :T,X->r^u,.)(^)A^. 

Following [9|, the corresponding tangent lift of fq.{.) is the time dependent vector 
field /^^'"(.) € TTM on TM 



(2.8) 

which is given locally as 



fq- KVx) 



dr 



(2.9) 



Jqi 



'(x,Vx) 



d 



dx^ dv^ 



and T$p''''(.) is evaluated on Vx € T^M, see [S]. The following lemma gives the 



relation between the push-forward of and the tangent lift introduced in (|2.9|) 



For simplicity and uniformity of notation, we use fq. instead of fq. . The following 
lemma is taken from [S] and its results are essential to obtain the Minimum Principle 
along the optimal trajectory for standard optimal control problems. In this paper we 
use the same results to obtain the HMP statement for hybrid systems. 

Lemma 2.5 (0). Consider fq^{.,u{.)) : M x I ^ TM,I = [<i,<i+i) as a time 
dependent vector field on M and as its corresponding flow. The flow of /^'", 

denoted by ^ : I x I x TM — > TM, satisfies: 



'^{t,s, {x,v)) 



{^^;f{x),T^^;f{v))eTM, 



{x,v) e TM. 
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3. The Pontryagin Minimum Principle for standard optimal control 
problems. In this section we focus on the Pontryagin Minimum Principle (PMP) 
for standard (non-hybrid) optimal control problems defined on a Riemannian manifold 
M. A standard optimal control problem (OCP) can be obtained from a BHOCP, see 



(2.4), by fixing the discrete states qi to q, and hence L to the value 0. The resulting 



optimal control problem in Bolza form becomes that of the infimization of the cost 



xit) 










l{x{t),u{t)) 



[ 2.4 ) with respect to state dynamics which by suppressing notation of q may be written 

1 = fixit),u(t)), x{t) e M,u{t) eU,t e [to,tf]. 

3.1. The Relationship between Bolza and Mayer Problems. In Section 

2 both the BHOCP and the MHOCP were introduced; since the results in this paper 
are only stated for the Mayer problem we now briefly explain the relationship between 
them. 

In general (see [5|), a Bolza problem can be converted to a Mayer problem with 
state variable x := {x,Xn+i) by adjoining an auxiliary state Xn+i to the state x, one 
then defines the dynamics to be given by 

(3.1) i{t) 

where / and I are respectively the dynamics and the running cost of the Bolza problem. 
Then the equivalent Mayer problem is obtained by the infimization of the penalty 
function h(.) defined as follows: 

(3.2) h(x{tf)) = h{x{tf),Xn+i{tf)) ■■= Xn+i{tf) + h{x{tf)) = J{ta,tf,xo,u), 

where h is the terminal cost function of the Bolza problem. Note that after such a 
transformation from a Bolza problem the state space of the resulting Mayer problem 
is Als X R, where is the state manifold of the Bolza problem. 

3.2. Elementary Control and Tangent Perturbations. We now present 
some results from [1] , [S] and . It is essential to note that henceforth in this paper 
we treat the general Mayer problem with state space manifold denoted by A4. In 
the special case where Mayer OCP is derived from a Bolza problem A4 b takes the 
product form given in the previous section. 

Consider the nominal control input u(.) and define the associated perturbed con- 
trol as 



(3.3) u^(t\m){t,<^) = I 



u{t) elsewhere, 



where < e < oo,ui e U. For brevity in notation it7r(ti.ni)(^7 e) shall be written 
M^(t, e). 

Associated to u^(.,.) we have the corresponding state trajectory Xtj{.,.) on AA. 
It may be shown under suitable hypotheses, lim^^^XT^{t,e) = x{t) uniformly for 



to l^t <tf, see [T7] and [5T]. Following (2.5 1, the flow resulting from the perturbed 
control is defined as: 

: [0,t]^X, X e M,t,s e[to,tf],T eR+ ,-^^^;f-''{e) e M, 

where $|^*'^^'^(.) is the flow corresponding to the perturbed control u.„{t, e), i.e. <i>||.*'^-''^(e) 
'^'^^u^{t,i){x{s)). The following lemma gives the formula of the variation of $|^*'^-''^(.) 
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at the hmit from the right 0+ :— linieioe. We recall that the pomt G {to,tf) is 
called a Lebesgue point of u{.) if, ([J): 

sUti |si - i^l Jji 

For any u e Loo([to;i/]5 ^^): may be modified on a set of measure zero so that all 
points are Lebesgue points (see [28^, page 158, and [29[) in which case, necessarily, 
the value of any cost function is unchanged. 

Lemma 3.1 ([5]). For a Lebesgue time , the curve <^^^ j^'^''^ {.) := <i>^*„^''()^) (x(s)) : 
[0, t\ Ai is differentiable from the right at e — and the corresponding tangent 
vector ^$|^*y'''''^|e=o given by 

(3.4) ^<s>^^y^'^U=o = f{x{t'),ui)^f{x{t^),u{t^)) e r,(,i)X. 



The tangent vector f{x{t^),ui) — f{x{t^),u{t^)) is called the elementary perturbation 
vector associated to the perturbed control u^^ at {x{t),t). The displacement of the 
tangent vectors at x € is given by the push-forward of the vector field /, see 
sections below. 

3.3. Adjoint Processes and the Hamiltonian. In this section we present the 
definitions of the adjoint process and the Hamiltonian function which appear in the 
statement of the Minimum Principle. In the case Ai = R", by the smoothness of / 
we may define the following system of differential equations: 

(3.5) A^(t) = -A^(i)|^(x(t),u(i)), t€[to,tf], x(to)eM". 

The matrix solution ip of (p{t) = ^{x{t),u{t))ip{t), where ip{0) — /, gives the trans- 
formation between tangent vectors on the state trajectory x{t) from time t-^ to t^ (see 
|21j). in other words, considering vi as a tangent vector at x{t^), the push- forward of 

vi under ' Ms 

V2 = T<^f-''\vi) = ifit" - t^)v,, «i G T,(ti)]R" ~ R",t\t^ e [to,tf]. 

Evidently the vector v{t) — 0(t)w(O) is the solution of the following differential equa- 
tion: 

df 

(3.6) v{t) = -^{x{t),u{t))v{t), v{0) = vo,v{t) e r,(t)R" ~ R". 



A key feature of the solution of (3.5) is that along x{.), A {■)v{.) remains constant 
since 

|(A^(t)t.(i)) = \^it)vit) + X^mt) = -X^{t)^v{t) + )^''it)^vit) = 0. 

(3.7) 

For a general Riemannian manifold Ai, the role of the adjoint process A is played by 
a trajectory in the cotangent bundle of Ai, i.e. X{t) E T*Ai. As in the definition of 
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the tangent lift, we define tlie cotangent lift which corresponds to the variation of a 
differential form a eT*M (see gnj): 

d 



(3.8) 



where x = x(t) 
we have 



^ff \x{s)). As in (|2.9|), in the local coordinates, (x,p), of T*M, 



(3.9) 



/^'•"(a;,p) 



,df- 



dx^ 



dxi 



where r*$L*'*'(.) is the pull back of applied to differential forms G T*M. 



-f 



The minus sign in front of i in ( 3.8 ) is due to the fact that pull backs act in the opposite 



sense to push forwards, therefore the variation of a covector ax si x = x{s) depends 
upon which notationally corresponds to —t, see |40]. The following lemma gives 
the connection between the cotangent lift defined in (3.8) and its corresponding flow 



on T*M. Let (T*4>^'''*V^ = T"**/ the pull back of whose existence is 

guaranteed since $ : Al is a diffeomorphism, see [ID] . 

Lemma 3.2 ([S]). Consider f(x(t),u{t)) as a time dependent vector field on M., 
then the flow T : I x I x T*M -> T*M, I = [ta,tf], satisfies 

(3.10) T{t,s,{x,p)) = {^f'\x),{T*^f'YHp)), {x,p)eT*M, 

and F is the corresponding integral flow of f^ . 



We now generalize ( 3.5 ) and ( 3.6 ) to differentiable manifolds. Along a given trajectory 



A(.) e T*M, the variati on w ith respect to time, X{t), is an element of TT*M. The 
vector field defined in is thus the mapping /^'^" : T*M TT*M, which 

generalizes (3.5) to a mapping from \{t) E T*A4 to X{t) £ TT*M. The generalization 
of (3.7 1 to is given in the following proposition. 



Proposition 3.3 ([5 ). Let /,(.,«(.)) : x / ^ TM, I = [io,i/], be a time 
dependent vector field giving rise to the associated pair 

jT.ujT\u. ^^jg^ ^i^^g 

an 

integral curve of f{.,u) on A4 

(F,*) : /-^ R, 

is a constant map, where F is an integral curve of f'^ in T*Ai and ^ is an integral 
curve of /"^'" in TA4 . 



The integral curves F and are the generalizations of A(.) and v{.) in (3.6) and 



(3.7) in R" to the case of a differentiable manifold A4. The corresponding varia- 



tion of the elementary tangent perturbation in Lemma 3.1 is given in the following 
proposition. 

Proposition 3.4 (^5]). Let * : [t'^,tf] TM be the integral curve of f'^'" with 
the initial condition 'i'{t^) — [f{x{t^),ui) — f(x{t^),u{t^))] G T^ij^i-^M, then 

|<f"|.=o = *(<), t£[t\tf]. 



By the result above and Lemma |2.5| we have 

T'ff'"\[f{x{t^),u,) - f(x{t')Mt'))]) € Tx(tr)M. 



de ""'f 



|e=0 
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3.4. Hamiltonian Functions and Vector Fields. Here we recall the notions 
of Hamiltonian vector fields (see e.g. [3]), which were employed in [T] to obtain a 
Minimum Principle for optimal control problems in a geometrical framework. 

For an optimal (non-hybrid) control problem defined on the state manifold A^, 
with controlled vector field f{x{t),u{t)) G T^^^ffAi, the Hamiltonian function for the 
Mayer problem is defined as: 

(3.11) i7 : T*7W X [/ ^ R, 



(3.12) H{p,x,u) = {pJ{x,u)), p£T:M, fix,u) e T,M. 

In general, the Hamiltonian is a smooth function H e {T* A4) with an associated 
Hamiltonian vector field l} E X{T*M) defined by (see [T]) 



{.,ll) = dH, \eT*M, 



where lux e n'^{T*M) is the symplcctic form (see e.g. [T5], [33]) defined on T*M 
(see [Ulin]) and X{T*M) is the space of smooth vector fields defined on T*A^). The 
Hamiltonian vector field satisfies i'^'^x = —dH, (see [1]) where ij^ is the contraction 

mapping (see [El [23]) along the vector field . In the local coordinates {x,p) of 
T*M, we have: 

(3 13) dH -Y—dp' + —dx' li-Y——-— — 

^ dp^ dx^ ' ^ dp^ dx^ dx^ dp^ 

2—1 i—l 

So the Hamiltonain system \{t) — lt(A), A G T*jv[ is locally written as: 

x{t) - p{t) - 

dp'' ' dx^ ' 

where A(t) = {x{t),p{t)) € T*M, x{to) = xq, A(t/) = dh{x{tf)) G T*(^tf)^^ 
where 

(3.14) dh^Y ^dx' (^n\M). 

i—l 

3.5. Pontryagin Minimum Principle. For standard (non-hybrid) optimal 
control problems defined on a Riemannian manifold we have the following result 
known as Pontryganin Minimum Principle. 

Theorem 3.5 ([2I])- Consider an OCP satisfying hypotheses A1-A3 (L = 
0,qi = q) defined on a Riemannian manifold M. Then corresponding to an optimal 
control and optimal state trajectory pair, {u°,x°) there exists a nontrivial adjoint 
trajectory A°(.) = {x°{.),p°{.)) G T*M, defined along the optimal state trajectory, 
such that: 

H{x°{t),p°{t),u°{t)) < H{x°{t),p°{t),v), \fveU,te [ta,tf], 
and the corresponding optimal adjoint trajectory X°{.) G T*A4 satisfies: 

A°(t)-]?(A°(t)), te[to,tf]. 

The Minimum Principle gives necessary conditions for optimality; conditions un- 
der which the Minimum Principle is sufficient for optimality are given in [?■ and |10] . 
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4. The Hybrid Minimum Principle for Autonomous Impulsive Hybrid 
Systems. Here we consider a simple impulsive autonomous hybrid system consisting 
of one switching manifold. Consider a hybrid system with a single switching from 
the discrete state qo to the discrete state qi at the unique switching time tg on the 
optimal trajectory (x°{.),u°{.)) associated with the dynamics: 

i9o(^) = /90 (a; (i), a.e.te [to,ts), 



igi(i) = fqi{x{t),u{t)), a.e. t e [ts,t/], 

where x{to) — xo,ts — ti,tf = ^2 and 

- My. [U,U+i)^TM, 

together with a smooth state jump C := Cijo.gi : ^ with the following action: 

x°{ts) = ({x^it-j) = lim^_^^-C{x{t)), x°{t-) eScM. 

We shall assume the switching manifold S is an embedded n — 1 dimensional sub- 
manifold S := fiqo.gi which consists of a single switching manifold (see Section 2). 
Following |30| , the control needle variation analysis is performed in two distinct cases. 
In the first case, the variation is applied after the optimal switching time, therefore 
there is no state variation propagation along the state trajectory before the switching 
manifold, while in the second case, the control needle variation is applied before the 
optimal switching time. In this case there exists a state variation propagation along 
the state trajectory which passes through the switching manifold, see [3D] (see Figure 



4.1) 



Recalling assumption A 2 in the Bolza problem and assuming the existence of opti- 
mal controls for each pair of given switching state and switching time, let us define a 
function v : A4 x [tQ,tf) ^ R for a hybrid system with one autonomous switching, 
i.e. L = 1, as follows: 

(4.1) v{x,t) = infu(zuJ{to,tf,ho,u), 



where 



$V ' "'M (^S CM. 



4.1. Non-Interior Optimal Switching States. In this subsection, we show 



that the optimal switching state for an MHOCP derived from a BHOCP (see (3.1)) 
cannot be an interior point of the attainable switching set A{xo, tg) <Z S, to < tg < tf, 
for an MHOCP which is defined as 

A{xo,tg) ^ {x e S s.t. 3u eU,<i>'-fr*°\xo) ^ x}. 
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Note that the state manifold of a Mayer problem derived from a Bolza problem 
is Als X R where A4b is the state manifold of the Bolza problem. In this paper, for 
simplicity and uniformity of notation, the state manifold and the switching manifold 
of a Mayer problem shall also be denoted by A4 and S respectively. 



Lemma 4.1. Consider an MHOCP derived from a BHOCP as in (3.1), (3.2) 



with a single switching from the discrete state qo to the discrete state qi at the 
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Fig. 4.1. Hybrid State Trajectory On the Sphere 



unique switching time ts on the optimal trajectory {x° {.) , u° {.)) and an n dimensional 
switching manifold S = Sb x M := Uq^^q-^ defined in an n + I dimensional manifold 
A4 = X where Sb <Z Mb is the switching manifold of the BHOCP. Then 
an optimal switching state x°{t'^) G S at the optimal switching time tg cannot he an 
interior point of A(xQ,ts) in the induced topology of S from Ai. 

Proof. If v4(xo, tg) has empty interior in the topology induced on S from M. the 
result is immediate. Assume x°{t~) is an interior point of A{xQ,ts), i.e. there exists 
an open neighbourhood S^o^j-) C A{xq, tg) of x°{t~) e S. Let us denote a coordinate 
system around x°{t~) by {x°, x'^j^i), where x°-^j^^ corresponds to the running cost of 
the Bolza problem, see ( |3.1[ ). Since the switching manifold of the MHOCP is defined 
by iS = Sb x R, we may choose a neighbourhood S^-ofj-) of x°{t~ ) in the induced 
topology of S with the last coordinate Xn+i free to vary in an open set in R. Hence 
fixing X J (ij ),..., there exists y e -B^o(t-) such that 

y^=x°{t';), i^l,...,n, ?/„+i < a;°+i(i7), 

which is accessible by fqg subject to a new control u(t), to < t < t^, where ii is not 
necessarily equal to u°. Set the control u{t) — u°{t), tg < t < tf\ then u{.) results 
in an identical state trajectory on [is,^/] for the Bolza problem (since the variables 
Xi,...,a;„ do not change). However, the final hybrid cost corresponding to the new 
switching state y is 

ftf 

Jito.tf, (xo, go); 1, u°)) = Vn+i + J li{x°{t),u°{t))dt + h{x°{tf)) < w(x°(t;), t,), 

where t/„+i = J^^"^ lo{x{t),u{t))dt < x'^^i = J^^"^ lo{x°{t),u°{t))dt, contradicting the 
optimality oi x°{tj); we conclude x°{tj) lies on the boundary oi A{xQ,ts). □ 
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However the lemma above implies that the hybrid value function defined by (4.1 1 
cannot be differentiated in all directions at the optimal switching state for MHOCPs 
derived from BHOCPs. Hence the main HMP Theorem |4.5| for MHOCPs below applies 
in potential to all MHOCPs derived from BHOCPs. The general HMP statement 
given below employs a differential form dN^ corresponding to the normal vector to the 
switching manifold 5 C M at the optimal switching state x°{ts)- Now in the special 
case where the value function can be differentiated in all directions at x°{ts) G S, it 
may be shown that dN^of^^^-^ = fidv{x"{ts),ts) for some scalar /i, see [35], Lemma A.l; 
this fact has significant implications for the theory of HMP as is shown in [331 IMl ISH] • 

4.2. Preliminary Lemmas. In order to use the methods introduced in [TJ [51 



[21] . we establish Lemma 4.2 using the perturbed control u,r(-, •) and the associated 



state variation at the final state x°{tf). Denote by ts{e) the switching time corre- 
sponding to UT^{t,e). Note that, in general, j"'' (xq) does not necessarily intersect 
the switching manifold at ts. Hence, we introduce the following perturbed control to 
guarantee that eventually the state trajectory meets the switching manifold. 



(4.2) u,(i,e) 




t <t^ ~e 

<t<ts 

ts<t< t,{e) 



The following lemma shows that under the control above, the hybrid state trajectory 
always intersects the switching manifold for sufficiently small e G E,''". 

Lemma 4.2. For an MHO CP satisfying A1-A3 with a single switching from the 
discrete state qo to the discrete state qi at the unique switching time ts on the optimal 
trajectory {x° {.) , u° (.)) , the state trajectory associated to the control needle variation 



M7r(i, e) in (4--2) intersects the n — \ dimensional switching manifold 5 C for all 
sufficiently small e G ]R+ and the corresponding switching time tsie) is differentiable 
with respect to e. 

Proof. The proof is given in Appendix [^ □ 

Lemma 4.3. For an MHOCP satisfying hypotheses A1-A3 with a single switch- 
ing from the discrete state qo to the discrete state qi at the unique switching time tg 
on the optimal trajectory {x"{.),u°{.)), the state variation at the switching time tg, 



d<s> 



i.e. |e=0; is given as follows: 



de ' 



-_o^TCoT^f/ '[/,„(x°(ti),«i)-/,,(x°(ti),zi°(ii))] 

+i^U=o)-{TC[f,„ix%t-),u%t-))]-f,A^''{ts),u''itg)))^ 

t^ e [ta,ts). 



Proof. The proof is obtained by the differentiation of the state flow combination; 
it is given in Appendix [B] □ 

The following lemma gives a variational inequality as a necessary condition for 
the minimality of the Mayer hybrid cost function h{x{tf)) — J{tQ,tf,XQ,u) defined 
by (3.2 1. This inequality enables us to construct an adjoint curve A € T*Ai which 
satisfies the HMP equations. 
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In order to prove the following lemma we use the Taylor expansion of a smooth 
function defined on a Riemannian manifold, see [2] and |3T|. For a given smooth 
function h : M. ^ R and a vector field X S 3C(A^), where X{M.) defines the space 
of all smooth vector fields on M., the Taylor expansion of h around p G along a 
tangent vector Xp e TpM is given by (see [31]): 

^n — 1 

hiexpp9Xp)=hip) + e{Vxh){p) + ... + ^^^-yyy X iVT'h){p) 



— / {l~t)'^-\V'^xh){exppteX)dt, o<9<e*, 



(n- 
(4.3) 

where exppOXp is the geodesic emanating from p ^ M. with the velocity Xp e TpM., 
X{p) = Xp and 9* is the upper bound of the existence of geodesies on the Riemannian 
manifold M. The existence of 9* is guaranteed by the fundamental theorem of exis- 



tence and uniqueness of geodesies (see ^9,). In (4.3 1, V : X{M) x X(A^) — )■ X{M) is 



the Levi-Civita connection on which satisfies the following characteristic relations: 

XgM {Y, Z) = gMi'^xY, Z) + gM {Y, VxZ), VX, F, Z e X(X), 

(i) : VxF-VyX- {ii):Vxf = X{J) yX,Y e X{M), f E C°°{M). 
(4.4) 

Based on the fundamental theorem of existence of geodesies on Ai (see [IS]), for 
each VTr{tf) € Tx(tf)M. there exists a geodesic emanating from x{tf) with the velocity 

V^{tf). 

Lemma 4.4. For an MHO CP satisfying A1-A3 with a single switching from the 
discrete state qo to the discrete state qi at the unique switching time tg on the optimal 
trajectory {x°{.),u°(.)), 

(4.5) {dh{x°{tf)),v^{tf)) > 0, yv^itf) e Ktj, 
where 

(4.6) K,^=Kl^iJKl, 
and where 

K ^ U U T<S>l'fif,oix''{t),u,) - /,„(x°(t),w°(t))] C T,o(,^)X, 

ts<t<tf uiEU 

(4.7) 

and 

K= U U T^l'f'^ oTCoT<^>f/\f,,{x''it),u,)- f,,ix''{t),u''m 
to<t<ts uieu 

+(^|.=o)^4*/;*=)(TC[/,„(a;°(^7),^.°(^7))]-/,,(x°(^,),«°(^,)) 

(4.8) C T,o(,^)X. 
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Proof. To apply (4.3) to h, one needs to extend v.^{tf) £ T^(^f^-^M to a smooth 



vector field denoted by V^r G X{Ai) such that V-^{x{tf)) = VTt{tf). It is shown in 
that this extension always exists. 



Employing (4.31 on h along VTr{tf) and using the extended smooth vector field 
Vtt G ^{M), we have 



h{exp,o(^t^)ev^{tf)) = h{x°{tf)) + e{y^^h){x°{tf)) + o{e),Q< e < 



(4.9) 



Here we show that Kt^ , defined in Lemma 4.4 contains all the state perturbations 



at tf. Lemma 3.1 and Proposition 3.4 together imply that 



K = Ut.<*<t, {Ju,euT'fl'f''[Ui^%t),Ui)-U{x''{t),u°{t))] contains all the state 
perturbations at x{tf) for all the elementary control perturbations inserted after t^. 
For all the control perturbations applied at to < t < ts, either ts{e) < or ts < is(e), 
where ts{e) is the switching time corresponding to u,r(i, e)- 



Following Lemmas 4.3 and 4.2 in a local chart around x{ts), the differentiability 
of ts{e) with respect to e implies 



de ' 



+{^U=o){TC[Ui^^t;),u''{t;))]~f,,{x"iQ,u%t,)) 



therefore 



K 



U U {T<&i*;'*='oTCoT$g'*'[/,„(x°(^,Ul))-/,„(x°(^),^.°(^))] 

+ (^|e=o)T<i>^*;''=^(TC[/,oK(i;),«°(i;))] 

C r^o(t^)X,t e (to,ts), 

contains all the state variations at x°(tf) corresponding to all elementary control 
perturbations at t € (io,is)- 

Since Ktj, contains all the state perturbations at x°{tf), choosing VT^{tf) G Ktf C 
Tx{tf)M implies that at least at one particular time, one particular elementary control 
variation (t, e), where is the needle control resulting in the 

control variation it7r(i, e)) results in the final state variation v-jritf) G ^t/- 

Note that choosing e — 9, h{expx'>(tf)OvTritf)) and h{xe{tf)), where x^{tf) is the 
final state curve obtained with respect to e variation, are equal to first order since 
they have the same first order derivative with respect to e. By the construction of 
M-7r(i, e) G i^, ^t{if) is a curve in the reachable set of the hybrid system at tf. The 
minimality oix°{tf) consequently implies that h{x°{t})) < h{Xf{tf)); then h{xt{tf)) — 
h{expxf(ti)^VT^{tf)) — o(e) together with (4.9) implies 



(4.10) 0< (V^^/i)(a;°(t/)), K(x°(t/)) = z;.(t/), Vt.,(i/) € Kt,. 
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For the smooth function h : M. R, (4.4) (ii) imphes 



" r)h 

i—l * 

where the second equahty uses local coordinates. Therefore by the definition of dh 
we have 

{V^^h){x°{tf)) ^ {dh{x%tf)),v^{tf)), 

which implies 

{dh{x''{tf)),v^{t})) > 0, Vv^itf) e Kt^, 
and completes the proof. □ 



4.3. Statement of the Hybrid Minimum Principle. Generalizing the re- 
sults for Ai = R" in [3D], we have the following theorem which gives the HMP for 
autonomous hybrid systems with only one autonomous switching which occurs on the 
switching manifold S d M. 

For an MHOCP with a single switching from the discrete state qq to the discrete 
state qi at the unique switching time tg on the optimal trajectory u°(.)), where 

the switching manifold is an n — 1 dimensional oriented submanifold of we have 

(4.11) yXeT.S, gMiN,,X) = 0, 

where Nx S T^S C T^Ai is the normal vector at x°{tj) (the metric gM is positive 
definite). For use below we define a one form dN^, corresponding to by 

(4.12) dN,:=gM{Nx,-)eT:M, 

where the linearity of dN^ follows from the bi- linearity of gj^ ■ 

Theorem 4.5. Consider an impulsive MHOCP satisfying hypotheses A1-A3. 
Then corresponding to an optimal control and optimal state trajectory, u° and x° 
with a single switching state at {x°{ts),ts) , there exists a nontrivial adjoint trajectory 
A°(.) = (x°(.),p°(.)) €T*A4, defined along the optimal state trajectory, such that: 

Hg^ix°{t),p°{t),u°{t))<Hg^ix°{t),p''{t),ui), Vui e U,te[to,tf], 1 = 0,1, 

and the corresponding optimal adjoint trajectory X°{.) £ T* Ai satisfies: 

\o(t) = t,X^°{t)), t£[to,tf],l = 0,l, 

for optimal switching state and switching time {x°{ts),ts), there exists dN^ G T*M. 
such that 



p%t-)=T*ap''its))+^^dN^.^,-y 

p°(t-) e Tl^^,-)M, p°{ts) e r;„(,^^)X, 

(4.13) x°(t,) = Cix^it-)), 
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" dh 

(4.14) a;°(io)=xo, p^itj) = dh{x°{tf)) ^Tl^^^^^^M, d/i = ^ ^dx^ G r;>/, 

1=1 

where /i G R and T*C, : T* M. — > T*M.. The continuity of the Hamiltonian at 
{x°(ts),ts) is given as follows 

H,,ix°it:),p''{t:),u^t-)) = H,,ix°{t,),p"it,),u°{t,)). 

Proof. The proof is based on the control needle variation along the optimal state 
trajectory and employs the results of Lemma |44j it is given in Appendix [C] □ 
In the case where dim(S) < n — 1, the normal vector at the optimal switching state 
is not uniquely defined and ( |4.13 ) becomes 

p°{t-) - TX{p"{ts)) e T*t^,-^S p°{t-) e p°{t,) e t;„(,^)X, 

where T*^ S := {a e T*M, s.t. MX e T^S, {a, X) = 0}. 



5. Simulation Results. To illustrate the results above we consider an HOCP 
and employ the Gradient Geodesic-HMP (GG-HMP) algorithm (see [5S]). 
The HOCP is defined on a torus with the following parametrization: 

x{C,w) = {R + rcos{w))cos{C.), 
y{C,w) = {R + rcos(w))sin{Q, 
z{C, w) = rsin{w), w, C S [0, 27r). 

where R = l,r — 0.5. The induced Riemannian metric is given by 

(C, w) = {R + rcos{w)YdC ® dC, + r'^dw (g) dw. 



(5.5) q4 



The hybrid system trajectory goes through each discrete state in numerical order 
and the dynamics are given in the local parametrization space of the torus as 
follows: 



i) ( 2) ( i) ^ i 1 
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Fig. 5.1. Hybrid State Trajectory On the Torus 



(5.6) 



c 



1 owe 

3 \ w 



1 



W I \ 6 J \ W J \ 1 

The switching submanifolds and the cost function arc defined as follows: 
(5.7) ={0<u;<27r,C-0}, n,,,,, - {0 < w < 27r, C = ^} 



(5.8) n,,,,3 ={0<u;<2^,C= |}, 71,3^,, = {0 < < 27r, C = |}, 



Stt 1 f 

(5.9) rig,,,, = {0 < u- < 27r, C = y }, J^^ u\t)dt, 

and the boundary conditions are given as: 

(5.10) xq = (1.4117, -0.4367, -0.1478) e ]R^ 
xf^ (-0.1478,-0.49980,0.10130) e R'\ 

The hamiltonian functions are given as 

^ ^ -'^^ -'^-^-^ - '^^ - ^-^^ ' ^ V lu'it), i ^ 0, 5, t e [u 



(5.11) 
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Fig. 5.2. Adjoint Processes 
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Fig. 5.3. Control Function 
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The GG-HMP algorithm is an extension to Ricmannian manifolds of the HMP algo- 
rithm introduced in [30 ; this is done by introducing a geodesic gradient flow algorithm 
on S and constructing an HMP algorithm along geodesies on S. Figure |5.1| shows 



the state trajectory on the torus and Figure 5.2 depicts the adjoint variable with the 
discontinuity at the optimal switching times 
tl = [1.2159, 2.5142, 4.0571, 5.6186, 6.3307]. 



Appendix A. Proof of Lemma |4.2[ 

Proof. Since 5 is a smooth embedded submanifold of A4 the inclusion i : S —?' M. 
is a topological embedding and hence its rank is constant (see [33]) • -^Y the Rank 
Theorem for Manifolds (see [l^), i may be locally given as 



3.2 



z(a;i, ...,a;„_i) = (a;i, 2:„_i, 0). 

Hence, S is locally homeomorphic to ]R"~^. As stated in Subsection 

converges to x°{ts) e 5 as e | (see [T7]), therefore ^^y*°\xo) converges into any 
neighbourhood of x°{ts) G 5 as e | 0. Let us denote the coordinate domain neigh- 
bourhood given by the Rank Theorem as U^aff-y where x°{t'^) = ' {x{t^)) G S. 

Consider < St such that <i>^*°^'^*'*''''(x°(i7)) G U^a(f-y In the local coordinate 
system around x°{t'^) defined above, the switching manifold S separates U^a^^--^ into 
two subsets , _,,f7^ , where , — {x € U^a(f-\,Xn < 0} and , = 
{x S U^a(^i.--j,Xn > 0}. For definiteness, we assume that first, the state trajectory 
enters , and second, it enters , after meeting the switching manifold; 

therefore 4>^/=+**'*''Va;°(C)) e , for aU sufficiently smaU dt > 0. The conver- 

JqQ \ \ A // X°{ts ) 

gence of ^^^"j^^^'^°\x{ts)) to ^''^"'^^*^'^"\x°{tj)) implies that for sufficiently small e, 
^^°f'^*'*"\x{ts)) e ^x°{t^y '^^^'^^ tiy the continuity of the trajectory there exists a 



switching time, is(e)j such that ^ Figure 

Furthermore by the continuity of the state trajectory, we may choose < e sufh 
ciently smah that j^'J'*"^ (a;(is)) e ^a;°(t7)- Let us define : ]R+ x R ^ R by 

^'(e,i) = Xn ° ^t'] where a;„ is the last coordinate function. Hence, the 

differentiability of Vl/ with respect to t is immediate by the construction of since 
'^'^df It^(e) = fq^{x{ts{e))), where is the corresponding coefficient of the last co- 
ordinate of fq^. 

In order to show the differentiability of ^I' with respect to e the following needle vari- 
ation is applied 



A.l 



(A.l) u^(i,e) 



u°{t) t<t^ -e 

ui -e <t<t^ 

u°{t) <t<ts 



From Section 3 we recall that <l>^*y-''^(e) ^'^^^^^J^^ ,,^{x{s)) then one can verify 



that, by the results of Lemma [3.1| and Proposition |3.4[ the needle variation control 



UT^{t, e), given in (3.3 1, results in the following tangent perturbation vector at t^, where 
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Fig. A.l. Nominal and Perturbed State Trajectories 



£ e [0, eo) for some cq > 0. 



TTjgn V ^ 71-, i V / 



7W. 



(A.2) 



That implies the difFerentiabihty of ^' on [0,eo), where (see Figure A.2 1 



The transversahty hypothesis at the intersection of the state trajectory and the 
switching manifold implies that fq„{x{ts{e))) ^ 0; then by employing the Implicit 
Function Theorem (see !23j, Theorem 7.9) we have 

*(e,ts(e)) = 0^ 3k : M, s.t. K(e) = is(e), 

and K and ^ both are C^; then the derivative of k(.) with respect to e is given as 



(A.3) 



where T"$ 



L) is the nth coordinate of d $(*'^'*).^-| ) 
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Fig. a. 2. Nominal and Perturbed State Trajectories 



This completes the proof of differentiabihty of ts(e) with respect to e. The proof 
for the differentiabihty of ts (e) in the case where ts (e) < <s parahels the proof given 
above. □ 



Appendix B. Proof of Lemma |4.3[ 

Proof. 

Without loss of generality assume tg < is(e), then 



where '''^(e) = o •''^(e) and x(t^) = x, then in a local coordi- 

nate system of x{ts) we have 

+ x,iQ) } - { f,, {x''{t),u°{t))dt + CK(i;))}. 

Since u.,^{t,e) = u°{ts),t e [is,i7(e)), fqg{xe{t),u°{ts)) is differentiable with re- 
spect to t. Hence by the Taylor expansion of C around Xe{ts) and the Mean Value 
Theorem we have 

fg„{x,{t),U°{t,))dt + X,{U))j = 

CixSs)) + - ts) X TC.fgoi^S),u°{U)) + o{Sx), 

where t g {ts,tj (e)). Applying the Taylor expansion of around x°{ts) imples 

C(x,(i,)) - C(x°(t;)) = TC{x,{Q - x^itj)) + o{Sx), 
where by the definition of the derivatives we have 

L^o = lim- "'-^'1 ^'^ 



I fc U ----- 

ae €^0 
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(B.l) 



lim 



'' o C o ' 

Jqi J qQ 



therefore as e | 0, Lemma 4.2 and (B.l ) together yield 



Tjq 



de 



de 



dtsje) 
de 



|.=o.(TC(/,oK(t;),u°(i;)))-/,,(x°(<,),u°(i,))). 



Lemma 3.1 and Proposition 3.4 complete the proof for the case ts < ts(e). The same 
argument holds for ts{e) < ts with a sign change for ^^^^l^^o- It should be noted 



that the derivative in (B.l I gives the state variation at ts{e), therefore the nominal 
flow is subtracted from the perturbed one up to ts{e).0 



Appendix C. Proof of Theorem 4.5 



Proof. We split the proof into the following steps: First, the needle variation is 
applied at t^, where tg < < t f and tg is the optimal switching time on the switching 
manifold from qg to qi, hence there is no switching phenomena after t^. At this stage 
the proof is same as the proof presented in pj and Second, the needle variation 
is applied at , to < < tg. Third, we show that the constructed adjoint variable, 
A, satisfies the Hamiltonian equations and, fourth, the continuity of the Hamiltonian 
at the optimal switching state x°{ts) and time ts is obtained. 

Step 1 : Choose the following control needle variation: 



u^{t,e) 



ui t^ -e<t <t^ 
u°{t) elsewhere 



where ts <t^ < tf,ui £ U. By Lemma 3.1 the state variation at t^ is 
[Jq^{x°{t^),ui) ~ fq^{x°{t^),u°{t^))] G T^o(ti)A^. By the definition of Ktj we have 

Lemma |4.4| implies that 

o< (dM^°(^/)),^<^>;*;^*')([^(x°(^l),^.l)-/,,(x°(^l),u°(^l))])) , 

and by Proposition |3.3| 



< {dh{x°{tf)),T'^^;f^U,{x''{t'),u,) - U,{x°{t'),u%t'))) 
= {T*^^;fhh{x°{tf)),fq,{x"{t^),u,)^f,,{x"{t^),u\t^))), 

ts <t^ < tf. 

Therefore 

'x^tf)),Ui^"'^'^ 



{T*^lf^dh{x''{tf))J,,{x''it'),u''it')) 



(C.l) <{T*<i>l'f >dh{x%tf))J,,ix"{t'),u,))), ts<t'<tf, 



for all ui £ U and setting p°{t) := T*^'j'''*'' dh{x°{tf)) yields a trajectory p°(.) satis- 
fying the minimization statement of the theorem. 
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u^(t, e) 



Step 2: Here we use the needle variation before the optimal switching time tg i.e: 

ui -e<t<t^ 
u°{t) elsewhere ' 

where < ts,ui E U. Similar to the first step, the derivative of the state trajectory 
with respect to e at is obtained as [/g^ (a;°(t^), ui) — f q^lx" {t^) , u° {t^))] G T^o((i)A^ 

and ^<i>|r*/'''^|e=o = S [i^j^s)- In order to use the method introduced in 

the first step, we describe the evolution of the perturbed state, , after the 

switching time. Note that each elementary control variation, UT^{t,e), results in a 
different switching time tg which depends upon both of e and ui. Now let us consider 
a state mapping from x{0-) to the switching state x{tj{e)) induced by the needle 
control variation; then the state variation at the optimal switching state x°{t~) is 
obtained as the push forward of 

^(t,^(0,*^),^ : [0, r] ^ 5, x € M, x{t,{e)) € 5, 

where -''^ (<^).* hx(t^)) g S and ts(e) is the switching time corre- 

sponding to the selected e. Here we have two possibilities, (i): tg < ts{^) and (m): 
ts{e) < ts- The corresponding control needle variations for these two possibilities are 
given as follows: 



(j) : ts < ts{e), UT,(t,e) 




t<t^-e 

t^ - e<t<t^ 

t^ <t<ts 

ts<t< ts{e) 



and 




t <t^ -e 
ts{e) <t<ts 

Notice that u°(ts) in (i) corresponds to fq^ under the optimal control and in (ii) 
corresponds to /^^ under the optimal control. The right differentiability of tg{e) with 
respect to e at by Lemma 4.2 (since the needle variation is defined for < e) and 
Lemma 4.3 in case (i), together imply 



de 1^=°^ ^ de 

+T'f^f:/\UXx%t'),u,) ~ u,ix''{t'),u"it'))] e r,„(,^^)5 c t^.^^^^M. 

(C.2) 

And in case (ii) we have 



|.=o)./,o(a:°(i7),«°(i7)) 



d^ 



de ' 



,dtsie) 



de 



U=o)-U>i^°it-),u''it-)) 



(C.3) 
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In the first case, (4.111 and (C.2| together yield 



de 



-\e=0^-{dN^o^,-yf,„ix"{t-),U°{t-)))~' 



(C.4) 



and in the second case, (4.11) and (C.3) together yield 
dtsie). 



de 



-|e=o=(div^o(,-),/,oK(i;),w°(i;))>-^ 



(C.5) 



where due to the transversality assumption in Definition 2.2 



( We notice that (| C.4[) coincides with (A.3| since in the coordinate system given 
in the proof of Lemma 14.21 dN^^^^--^ = (0, 0, 1) therefore 



Based on ( |C.2[ ) and (C.3), we have 

(t7(s).tl),x 



d<S>^ 

— -^^^ |e=o G ^a;°(t")'^- "^^^ variation of the state trajectory at ts is obtained by 

evaluating TC on 



{^U=o)-UXx''{tj),u''{t-))+T<^l-' >[UXx°{t'),u^) - U{x''{t'),u"{e))], where 
by definition, T( : TM — > TM is the push forward of C- Therefore 

Tc(('^|.=o)./,„K(i;),^°(i;))+T<I>y;'*')[/,„(x°(ti),«i) 



Parallel to the results in [30], and following Lemma 4.3 in case (i), the state variation 
at is 



-"Jit 



de 



|.=o=TCor4*;'*')[/,„(a;°(ti),ui)-/,„(a;°(ii),j.°(ii))] 



dts{e). 



(C.6) 
and in case {ii) 



£i$(*f)'*=)o$(*y*')(a;(<i)) , _ ,^ 

^ |.=o=TCor$(*;;* \f,,{xyt^),u,)-f,,{x%t^),u°{t^))] 
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dts{e). 



(C.7) 



Due to the sign change in (C.4) and (C.5), both of the cases (i) and (ii) give 



the same results as in (C.7) and (C.6| respectively. Henceforth, we only consider the 
second case. ( C.5[ ) and (C.7) together imply 



de 



(C.8) 

where T^^^f l^ldii £iho j ^ ^nd by Lemma 



4.4 



we have 



(C.9) < {dhix%tf)),T^l'f^^^[-^^ U=o,n 



de 



therefore 



0<{dh{x''itf)),ml['''^{TCoT^Jl^''\f,,{x"^ 



(C.IO) 

which implies 



(C.ll) 



By the linearity of push-forwards (see |23|), (C.ll I becomes 



0<(^T*^l[^'^^dh{x'>{tj)),TCoT^f/\f^^X^°^ 



+ {dN^ot^,-yf,,ix"it;),u"it;)))-' 

x(d7V,„(,-),T$y;'*')[/,„(a:°(ti),«i)-/,o(2^°(^'),«°(i'))]> 
x(T*$(*/'*=)rf/^(x°(t/)),^(a;°(i,),^.°(t,))-TC(/,„(a;°(i;),u°(i:)))), 



(C.12) 
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where one may write this as 



(C.13) 
where 



(C.14) 



A*=(dM^°(i/)),Tci>(*/'*=^[/,,(x°(i,),^°(t,))-TC(/,„(x°(i7),«°(i7)))]) 



y-{dN^.^^-y!,,{x°{t-),u°{t-)))-^ e R. 



Applying Proposition 3.3 to (C.13) on [i:^,^^ ], we have 



then, as in the first step, define 



p°{t) T*$^*; o T*C o T*$y/"=^rf/i(x°(t/)) 



(C.15) 



Since T*$^*° = /, choosing = tg gives 



(C.16) 



p°(t;) = r*c(p°(i.)) + MdiV,o(,-). 



Following (3.12) in the non-hybrid case, the Hamiltonian function is defined as 

+fiT*<^>f/'>dN^.^,-^}j,,ix''{t),u"m, te[to,U). 

(C.17) 



step 3: We need to show X°{t) = {x° {t) , p° (t)) = {x°{t),T*'S>jf- ' dhix^itf))), t G 
[ta,ts) and 

satisfy (3.14). By the definition of Hamiltonian fmictions given by (3.11) and ( 3.12[ ), 



A°(t) = l^^x°{t),T*^'^^^'^''>oT*CoT*'S?'^]f^'''>dh{x%tf))+^lT*^^^^^^^^^ te [ts,tf] 



it is obvious that x{t) — ^j^, i — 0, 1. To prove p°{t) — 



dx 



— 0, 1, first we use 



the adjoint curve expression \{t),t e [ts^tf] given by (C.l). Therefore we have 



po{t) = -T*<plfdh{x''{tf)), 
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where together with Lemma|3.2| and |3.9| imphes 



(C.18) 



Same argument holds for = r*$^*» o T*C o T*<^y'^'''dh{x°{tf)) 



dH,,{x°{t),p°{t)) 
dx 



J 10 



111 



X"{ts )' 



t e [tQ,ts 



Step 4 ■ Here we complete the proof by obtaining the continuity of the Hamilto- 
nian at the optimal switching time tg. In |30j . the Hamiltonian continuity based on 
the control needle variation approach is derived only for controlled switching hybrid 
systems. We give a continuity proof in the case of autonomous switching hybrid sys- 
tems via the following algebraic steps. 
Notice that 

(T*$(*^;*^)dMx°(t/)),[^(x°(t,),z.°(t,))-rc(/,„(x°(t7),«°(i7))]) = 



T 



*^l[''^^dhix"{tf)),{dN^.^^-^J,,ix''it,),u%Q))-'x 



[/,,(x°(t,),u°(t,))-rao(x°(t;),7.°(t;))] 



(C.19) 



Therefore by (C.19) we have 

H,, (a;°(i,),p°(i,), w°(t,)) = {p{Q, f,, {x%Q,u°{t,))) 

= {T*^lff^Uhix"{tf)), ^°(t,))) by [Cl] 

= (T*$y/;*=)dM^°(^/)),TC(/,„K(t;),«°(t;)))> 

+ (T*<f>;*//='d/iK(i/)), 

X {dN^„^^-yf,,{x°{ts),u°%))) by[CT9l 

= (T*C o T*<^^}^f^Uh{x°{tf))J,,,{^°{t-),u°{t-))) 
(C.20) by[Cl4l 

hence by the definition of p in (C.l ) and ( |C.15 1 we have 

{p{ts)J,,{x'^%),U°{U))) = {p{t-)J,,{x%t-),U%t-))), 

which gives the continuity of the Hamiltonian at the switching time tg. □ 

It should be noted that setting C, — I above subsumes the results obtained in [30] for 

non-impulsive autonomous hybrid systems. 
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